Annealed Expectation-Maximization by Entropy Projection
نویسنده
چکیده
We present a new technique of annealing the EM algorithm to allow for its tractable application to fitting models which include graph structures like assignments. The method, which can be generally used to sparsify dependence models, is applied to solve the assignment problem for the shared-resources Gaussian mixture model (e.g. [4], [5],[9]), and is compared to (and contrasted to) the widely used technique of deterministic annealing (e.g. [8],[2]).
منابع مشابه
Gibbs Conditioning Extended, Boltzmann Conditioning Introduced
Extensions of Conditioned Weak Law of Large Numbers and Gibbs conditioning principle two probabilistic results which provide a justification of the Relative Entropy Maximization (REM/MaxEnt) method to the case of multiple REM distributions are proposed. Also, their μ-projection (Maximum Probability) alternatives are introduced.
متن کاملMaximum Entropy method with non-linear moment constraints: challenges
Traditionally, the Method of (Shannon-Kullback’s) Relative Entropy Maximization (REM) is considered with linear moment constraints. In this work, the method is studied under frequency moment constraints which are non-linear in probabilities. The constraints challenge some justifications of REM since a) axiomatic systems are developed for classical linear moment constraints, b) the feasible set ...
متن کاملEntropy Maximization Algorithm for Positron Emission Tomography
The expectation maximization (EM) algorithm is extensively used for tomographic image reconstruction based on Positron Emission Tomography (PET) modality. The EM algorithm gives good reconstructed images compared to those created by deterministic methods such as Filtered Back Projection (FBP) and Convolution Back projection (CBP). However, the computational complexity of EM-based algorithm is h...
متن کاملConditional entropy maximization for PET image reconstruction using adaptive mesh model
Iterative image reconstruction algorithms have been widely used in the field of positron emission tomography (PET). However, such algorithms are sensitive to noise artifacts so that the reconstruction begins to degrade when the number of iterations is high. In this paper, we propose a new algorithm to reconstruct an image from the PET emission projection data by using the conditional entropy ma...
متن کاملA Representation Approach for Relative Entropy Minimization with Expectation Constraints
We consider the general problem of relative entropy minimization and entropy maximization subject to expectation constraints. We show that the solutions can be represented as members of an exponential family subject to weaker conditions than previously shown, and the representation can be simplified further if an appropriate conjugate prior density is used. As a result, the solutions can be fou...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005